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(57) Abstract 

A method of spec- 
tral-morphometric analysis of 
biological samples, the biological 
samples including substantially 
constant components and suspected 
variable components, the method 
is effected by the following the 
steps of (a) using a spectral data 
collection device for collecting 
spectral data of picture elements of 
the biological samples; (b) defining 
a spectral vector associated with 
picture elements representing a 
constant component of at least one 
of the biological samples; (c) using 
said spectral vector for defining a 
correcting function being selected 
such that when operated on spectral 
vectors associated with picture 
elements representing other constant 
components, spectral vectors of 
said other constant components are 
modified to substantially resemble 
said spectral vector, (d) operating 
said coirecting function on spectral 
associated with at least the variable 
components for obtaining corrected 
spectral vectors thereof; and (e) 
classifying said corrected spectral 
vectors into classification groups. 




The normal group. 




FOR THE PURPOSES OF INFORMATION ONLY 



Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL 


Albania 


ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


AM 


Armenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


AT 


Austria 


FR 


France 


LU 


Luxembourg 


SN 


Senega) 


AU 


Australia 


GA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


AZ 


Azerbaijan 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


BA 


Bosnia and Herzegovina 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


BB 


Barbados 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


BE 


Belgium 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


BF 


Burkina Faso 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


BG 


Bulgaria 


HU 


Hungary 


ML 


Mali 


TT 


Trinidad and Tobago 


BJ 


Benin 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


BR 


Brazil 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


BY 


Belarus 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


CA 


Canada 


IT 


Italy 


MX 


Mexico 


UZ 


Uzbekistan 


CF 


Central African Republic 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


CG 


Congo 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


CH 


Switzerland 


KG 


Kyrgyzstan 


NO 


Norway 


ZW 


Zimbabwe 


CI 


C6te d'lvoire 


KP 


Democratic People's 


NZ 


New Zealand 






CM 


Cameroon 




Republic of Korea 


PL 


Poland 






CN 


China 


KR 


Republic of Korea 


PT 


Portugal 






CU 


Cuba 


KZ 


Kazakstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


LI 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







WO 00/17808 



PCT/US99/20636 



SPECTRAL BIO-IMAGING DATA FOR CELL CLASSIFICATION USING ' 

INTERNAL REFERENCE 

FIELD AND BACKGROUND OF THE INVENTION 

5 The present invention relates to spectral methods in general and, more 

particularly, to spectral imaging methods for cell classification, biological 
research, medical diagnostics and therapy, which methods are referred to 
hereinbelow as spectral bio-imaging methods. The spectral bio-imaging methods 
of the present invention can be used to provide automatic and/or semiautomatic 

10 spectrally resolved morphometries classification (e.g., detection, grading) of 
neoplasm, by standardizing the measured spectra of biological material present in 
biological samples in general, but more specifically when these samples are 
stained for microscopy imaging, and as a result enabling the building of libraries 
of spectral signatures for these biological objects, and therefore allowing 

15 automatic and semiautomatic analysis of such samples. Also, cytological or 
tissue section specimen which are generally stained with chromogenic dyes, 
simultaneously with, or without, specific tagged or marked expressed proteins 
and/or genes and/or DNA segments, to be measured by bright field light 
microscopy have the advantages over fluorescently dyed, tagged and/or marked 

20 specimen, of being significantly more permanent and therefore of providing 
means to repeat the tests at later times, of avoiding the background signals due to 
auto fluorescence of the specimen itself, and in general of being less expensive, 
at least at present. By helping overcome the signal variations due to drifts in 
staining colors and concentrations, due to different manufacturing processes of 

25 the stains, different origins of the stains, and other environmental reasons, and 
instabilities of the measuring instrumentation, due to drifts in the illumination 
spectrum and/or intensity, changes in the optics spectral transmission, and 
spectral response of the detector array, the methods can be used for the 
improvement and automatization of the detection of the spatial organization and 

30 of the qualification and quantification of cellular and tissue constituents and 
structures associated with, for example, tumorogeriesis, using, for example, light 
transmission microscopy combined with high spatial and spectral resolutions. 
Furthermore, the methods of the present invention can be used to improve the 
detection of cellular spatial organization and the quantification of cellular and 

35 tissue natural constituents, domains and structures, including, but not limited to, 
proteins, genes, DNA sections, subcellular organelles, and the like, using light 
transmission, reflection, scattering and fluorescence emission strategies, with 
high spatial and spectral resolutions, and may therefore be employed for 
classification of cancer cells and/or grading and/or staging the progression of 
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cancer, using, what is referred herein as, spectrally resolved morphometry, mainly 
for diagnostic and prognostic applications. In particular the methods of the 
present invention can be used for classification of cells to developmental stages, 
and to qualify and quantify metabolic processes within cells. The methods can 
further be used to develop new and more fine tuned indexes for neoplasm 
classification (including grading), which will eventually replace the existing 
indexes. Although the explanations and the treatment is shown for full spectral 
measurements encompassing a large number of wavelengths, it will be 
recognized on the basis of the description of the method, the assumptions and the 
provided mathematical modeling, that the method of the present invention is 
useful and valid for spectral imaging measurements which contain an arbitrary 
number of wavelengths in the defined spectral range, from one single wavelength 
to hundreds (the usual maximum number used in this technology), and more. 

A spectrometer is an apparatus designed to accept light, to separate 
(disperse) it into its component wavelengths, and measure the lights spectrum, 
that is the intensity of the light as a function of its wavelength. An imaging 
spectrometer is a spectrometer which collects incident light from a scene and 
measures the spectra of each pixel (i.e., picture element) thereof. 

Spectroscopy is a well known analytical tool which has been used for 
decades in science and industry to characterize materials and processes based on 
the spectral signatures of chemical constituents therein. The physical basis of 
spectroscopy is the interaction of light with matter. Traditionally, spectroscopy is 
the measurement of the light intensity emitted, scattered or reflected from or 
transmitted through a sample, as a function of wavelength, at high spectral 
resolution, but without any spatial information. 

Spectral imaging, on the other hand, is a combination of high resolution 
spectroscopy and high resolution imaging (i.e., spatial information). Most of the 
works so far described concern either obtaining high spatial resolution 
information from a biological sample, yet providing only limited spectral 
information, for example, when high spatial resolution imaging is performed with 
one or several discrete band-pass filters [See, Andersson-Engels et al. (1990) 
Proceedings of SPIE - Bioimaging and Two-Dimensional Spectroscopy, 1205, 
pp. 179-189], or alternatively, obtaining high spectral resolution (e.g., a full 
spectrum), yet limited in spatial resolution to a small number of points of the 
sample or averaged over the whole sample [See for example, U.S. Pat. No. 
4,930,5 1 6, to Alfano et al.]. 
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Conceptually, a spectral bio-imaging system consists of (i) a measurement 
system, and (ii) an analysis software. The measurement system includes all of the 
optics, electronics and the manner in which the sample is illuminated (e.g., light 
source selection), the mode of measurement (e.g., fluorescence or transmission), 
5 as well as the calibration best suited for extracting the desired results from the 
measurement. The analysis software includes all of the software and 
mathematical algorithms necessary to analyze and display important results in a 
meaningful way. 

Spectral imaging has been used for decades in the area of remote sensing 
10 to provide important insights in the study of Earth and other planets by 
identifying characteristic spectral absorption features originating therefrom. 
However, the high cost, size and configuration of remote sensing spectral 
imaging systems (e.g., Landsat, AVIRIS) has limited their use to air and satellite- 
born applications [See, Maymon and Neeck (1988) Proceedings of SPIE - 
15 Recent Advances in Sensors, Radiometry and Data Processing for Remote 
Sensing, 924, pp. 10-22; Dozier (1988) Proceedings of SPIE - Recent Advances 
in Sensors, Radiometry and Data Processing for Remote Sensing, 924, pp. 23- 
30]. 

There are three basic types of spectral dispersion methods that might be 
20 considered for a spectral bio-imaging system: (i) spectral grating or prism, (ii) 
spectral filters and (iii) interferometric spectroscopy. As will be described below, 
the latter is best suited to implement the method of the present invention, yet as 
will be appreciated by one ordinarily skilled in the art, grating, prism and filters 
based spectral bio-imaging systems may also be found useful in some 
25 applications. 

In a grating or prism (i.e., monochromator) based systems, also known as 
slit-type imaging spectrometers, such as for example the DILOR system: [see, 
Valisa et ah (Sep. 1995) presentation at the SPIE Conference European Medical 
Optics Week, BiOS Europe 1995, Barcelona, Spain], only one axis of a CCD 

30 (charge coupled device) array detector (the spatial axis) provides real imagery 
data, while a second (spectral) axis is used for sampling the intensity of the light 
which is dispersed by the grating or prism as function of wavelength. The system 
also has a slit in a first focal plane, limiting the field of view at any given time to 
a line of pixels. Therefore, a full image can only be obtained after scanning the 

35 grating (or prism) or the incoming beam in a direction parallel to the spectral axis 
of the CCD in a method known in the literature as line scanning. The inability to 
visualize the two-dimensional image before the whole measurement is completed, 
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makes it impossible to choose, prior to making the measurement, a desired region 
of interest from within the field of view and/or to optimize the system focus, 
exposure time, etc. Grating and prism based spectral imagers are in use for 
remote sensing applications, because an airplane (or satellite) flying over the 
5 surface of the Earth provides the system with a natural line scanning mechanism. 

It should be further noted that slit-type imaging spectrometers have a 
major disadvantage since most of the pixels of one frame are not measured at any 
given time, even though the fore-optics of the instrument actually collects 
incident light from all of them simultaneously. The result is that either a 

10 relatively large measurement time is required to obtain the necessary information 
with a given signal-to-noise ratio, or the signal-to-noise ratio (sensitivity) is 
substantially reduced for a given measurement time. Furthermore, slit-type 
spectral imagers require line scanning to collect the necessary information for the 
whole scene, which may introduce inaccuracies to the results thus obtained. 

15 Filter based spectral dispersion methods can be further categorized into 

discrete filters and tunable filters. In these types of imaging spectrometers the 
spectral image is built by filtering the radiation for all the pixels of the scene 
simultaneously at a different wavelength at a time by inserting in succession 
narrow band filters in the optical path, or by electronically scanning the bands 

20 using acousto-optic tunable filters (AOTF) or liquid-crystal tunable filter (LCTF), 
see below. Similarly to the slit type imaging spectrometers equipped with a 
grating or prism as described above, while using filter based spectral dispersion 
methods, most of the radiation is rejected at any given time. In fact, the 
measurement of the whole image at a specific wavelength is possible because all 

25 the photons outside the instantaneous wavelength being measured are rejected 
and do not reach the CCD. 

Tunable filters, such as AOTFs and LCTFs have no moving parts and can 
be tuned to any particular wavelength in the spectral range of the device in which 
they are implemented. One advantage of using tunable filters as a dispersion 

30 method for spectral imaging is their random wavelength access; i.e., the ability to 
measure the intensity of an image at a number of wavelengths, in any desired 
sequence without the use of filter wheels. However, AOTFs and LCTFs have the 
disadvantages of (i) limited spectral range (typically, X max = 2A, m j n ) while all 
other radiation that falls outside of this spectral range must be blocked, (ii) 

35 temperature sensitivity, (iii) poor transmission, (iv) polarization sensitivity, and 
(v) in the case of AOTFs an effect of shifting the image during wavelength 
scanning, demanding careful and complicated registration procedures thereafter. 
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All these types of filter and tunable filter based systems have not been 
used successfully and extensively over the years in spectral imaging for any 
application, because of their limitations in spectral resolution, low sensitivity, and 
lack of easy-to-use and sophisticated software algorithms for interpretation and 
5 display of the data. 

A method and apparatus for spectral analysis of images which have 
advantages in the above respects was disclosed in U.S. Pat. application No. 
08/392,019 to Cabib et aU filed Feb. 21st, 1995, now U.S. Pat. No. 5,539,517, 
issued Jul. 23, 1996, which is incorporated by reference as if fully set forth 

10 herein, with the objective to provide a method and apparatus for spectral analysis 
of images which better utilizes all the information available from the collected 
incident light of the image to substantially decrease the required frame time 
and/or to substantially increase the signal-to-noise ratio, as compared to the 
conventional slit- or filter type imaging spectrometer, and does not involve line 

15 scanning. According to this invention, there is provided a method of analyzing 
an optical image of a scene to determine the spectral intensity of each pixel 
thereof by collecting incident light from the scene; passing the light through an 
interferometer which outputs modulated light corresponding to a predetermined 
set of linear combinations of the spectral intensity of the light emitted from each 

20 pixel; focusing the light outputted from the interferometer on a detector array, 
scanning the optical path difference (OPD) generated in the interferometer for all 
pixels independently and simultaneously and processing the outputs of the 
detector array (the interferograms of all pixels separately) to determine the 
spectral intensity of each pixel thereof. This method may be practiced by 

25 utilizing various types of interferometers wherein the OPD is varied to build the 
interferograms by moving the entire interferometer, an element within the 
interferometer, or the angle of incidence of the incoming radiation. In all of these 
cases, when the scanner completes one scan of the interferometer, the 
interferograms for all pixels of the scene are completed. 

30 Apparatuses in accordance with the above features differ from the 

conventional slit- and filter type imaging spectrometers by utilizing an 
interferometer as described above, therefore not limiting the collected energy 
with an aperture or slit or limiting the incoming wavelength with narrow band 
interference or tunable filters, thereby substantially increasing the total 

35 throughput of the system. Thus, interferometer based apparatuses better utilize 
all the information available from the incident light of the scene to be analyzed, 
thereby substantially decreasing the measurement time and/or substantially 
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increasing the signal-to-noise ratio (i.e., sensitivity). The sensitivity advantage 
that interferometric spectroscopy has over the filter and grating or prism methods 
is known in the art as the multiplex or Fellgett advantage [see, Chamberlain 
(1979) The principles of interferometric spectroscopy, John Wiley and Sons, pp. 

5 16-18 and p. 263]. 

Consider, for example, the "whisk broom" design described in John B. 
Wellman (1987) Imaging Spectrometers for Terrestrial and Planetary Remote 
Sensing, SPIE Proceedings, Vol. 750, p. 140. Let n be the number of detectors in 
the linear array, m x m the number of pixels in a frame and T the frame time. The 

io total time spent on each pixel in one frame summed over all the detectors of the 
array is nT/vP*. By using the same size array and the same frame rate in a method 
according to the invention described in U.S. Pat. No. 5,539,517, the total time 
spent summed over all the detectors on a particular pixel is the same, nTlnr. 
However, whereas in the conventional grating or prism method the energy seen 

15 by every detector at any time is of the order of \ln of the total, because the 
wavelength resolution is \ln of the range, in a method according to the invention 
described in U.S. Pat. application No. 08/392,019 the energy is of the order of 
unity, because the modulating function is an oscillating function (e.g., sinusoidal 
(Michelson) or similar periodic function such as low finesse Airy function with 

20 Fabry-Perot) whose average over a large OPD range is 50%. Based on the 
standard treatment of the Fellgett advantage (or multiplex advantage) described 
in interferometry textbooks [for example, see, Chamberlain (1979) The principles 
of interferometric spectroscopy, John Wiley and Sons, pp. 16-18 and p. 263], it is 
possible to show that devices according to this invention have measurement 

25 signal-to-noise ratios which are improved by a factor of rP^ in the cases of noise 
limitations in which the noise level is independent of signal (system or 
background noise limited situations) and by the square root of the ratio of the 
signal at a particular wavelength to the average signal in the spectral range, at 
wavelengths of a narrow peak in the cases the limitation is due to signal photon 

30 noise. Thus, according to the invention described in U.S. Pat. No. 5,539,517, all 
the required OPDs are scanned simultaneously for all the pixels of the scene in 
order to obtain all the information required to reconstruct the spectrum, so that 
the spectral information is collected simultaneously with the imaging 
information. This invention can be used with many different optical 

35 configurations, such as a telescope for remote sensing, a microscope for 
laboratory analysis, fundus cameras for retinal imaging, fiber optics and 
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endoscopes for industrial monitoring and medical imaging, diagnosis, therapy and 
others. 

In a continuation application (U.S. Pat. application 08/571,047 to Cabib et 
al. 9 filed December 12, 1995, now U.S. Pat. No. 5,784,162, issued July 21, 1998, 

5 which is incorporated by reference as if fully set forth herein) the objective was to 
provide spectral imaging methods for biological research, medical diagnostics 
and therapy, which methods can be used to detect spatial organization (i.e., 
distribution) and to quantify cellular and tissue natural constituents, structures, 
organelles and administered components such as tagging probes (e.g., 

10 fluorescent probes) and drugs using light transmission, reflection, scattering and 
fluorescence emission strategies, with high spatial and spectral resolutions. In 
U.S. Pat. No. 5,784,162 the use of the spectral imaging apparatus described in 
U.S. Pat. No. 5,539,517 for interphase fluorescent in situ hybridization of as 
much as six loci specific probes (each loci located on a different chromosome) 

15 was demonstrated, as well as additional biological and medical applications. 

Spectral bio-imaging systems are potentially useful in all applications in 
which subtle spectral differences exist between chemical constituents whose 
spatial distribution and organization within an image are of interest. The 
measurement can be carried out using virtually any optical system attached to the 

20 system described in U.S. Pat. No. 5,539,517, for example, an upright or inverted 
microscope, a fluorescence microscope, a macro lens, an endoscope and a fundus 
camera. Furthermore, any standard experimental method can be used, including 
light transmission (bright field and dark field), auto-fluorescence and 
fluorescence of administered probes, etc. 

25 Fluorescence measurements can be made with any standard filter cube 

(consisting of a barrier filter, excitation filter and a dichroic mirror), or any 
customized filter cube for special applications, provided that the emission spectra 
fall within the spectral range of the system sensitivity. Spectral bio-imaging can 
also be used in conjunction with any standard spatial filtering method such as 

30 dark field and phase contrast, and even with polarized light microscopy. The 
effects on spectral information when using such methods must, of course, be 
understood to correctly interpret the measured spectral images. 

U.S. Pat. application No. 08/824,234, filed March 25, 1997, which is 
incorporated by reference as if fully set forth herein teaches methods for 

35 automatic and/or semiautomatic spectrally resolved morphometric classification 
(e.g., detection, grading) of neoplasm, which are designed to provide objective, as 
opposed to subjective cell (e.g., cancer cell) classification. According to the 
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method disclosed therein (a) a sample including at least a portion of at least one 
cell is prepared to be spectrally imaged; (b) the sample is viewed through an 
optical device optically connected to an imaging spectrometer for obtaining a 
spectrum of each pixel of the sample; (c) each of the pixels is classified into 

5 classification groups according to the pixels spectra; and (d) by analyzing the 
classification groups of pixels, the cells of the sample are classified into cell 
classes. This method was exemplified with respect to breast carcinomas. 

Morphometric classification of various tumor types, such as, but not 
limited to, leukemias, lymphomas, sarcomas and other carcinomas [see, for 

10 example, Clarke AM, Reid WA and Jack AS (1993) Combined proliferating cell 
nuclear antigen and morphometric analysis in the diagnosis of cancerous 
lymphoid infiltrates. J. Clin. Pathol. 46:129-134] are vastly implemented both in 
research medical practice. 

Nevertheless, as was recently published following an NIH workshop 

15 which evaluated the reliability of histopathological diagnosis by the best 
pathologists in the field of cancer diagnostics, there is a discordance among 
expert pathologists in the diagnosis of neoplasm. Based on this workshop, it was 
concluded that histopathological decision making is 100% subjective, regardless 
of the origin of specimen and that this state of affairs in histopathological 

20 diagnosis is not confined to a specific tumor, but is applicable to differential 
diagnosis in every organ. These conclusions were published in an editorial by A 
Bernard Ackerman (1996) entitled "Discordance among expert pathologists in 
diagnosis of melanocytic neoplasm", in Human pathology 27: 1 1 1 5- 1 1 1 6. 

Characterization of nuclear features by different techniques is used for 

25 determination of diagnosis, treatment and prognosis. Quantitative estimation of 
various histopathological parameters such as two dimensional estimates of 
nuclear profile area, nuclear profile densities and mitotic profile numbers have 
been shown to correlate with differentiation and prognosis. Alterations in nuclear 
structure are the morphologic hallmark of cancer diagnosis. Nuclear size, shape, 

30 chromatin pattern have all been reported to change in various cancer types. For 
example, blood cancer cells (e.g., leukemia and lymphoma cells) are unique in 
their morphological features, which render them amenable for detection and 
classification via morphometric analysis. The following provides few examples. 
B-ALL is characterized by lymphoblasts having a small cytoplasm, lacking a 

35 nucleolus and having an open chromatin structure. CLL is characterized by small 
yet apparently mature lymphocytes having a small cytoplasm and condensed 
chromatin structure. PLL is characterized by lymphocytes having a large 
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cytoplasm, round nucleus and pronounced nucleolus. HCL is characterized by 
lymphocytes featuring cytoplasmatic projections, giving them a "hairy" 
appearance. T-ALL is characterized by lymphoblasts having a cleaved or 
convoluted nucleus and open chromatin structure. Sezary syndrome is 

5 characterized by small or large cells featuring cerebriformed nucleus and/or 
vacuoles and condensed chromatin structure. Additional examples and 
descriptions associated with these and other diseases and available in Foon KA, 
Todd RF. Immunologic classification of leukemia and lymphoma. Blood 68:1, 
1986; The Non-Hodgkin ! s lymphoma pathologic classification project: NCI 

10 sponsored study of classification of NHL's Summary and description of working 
formulation for clinical uses. Cancer 49:2112, 1982; A revised European 
American classification of lymphoid neoplasms: A proposal from the 
International Lymphoma Study Group. Harris NJ et al. Blood 84:1361, 1994, 
which are incorporated by reference as if fully set forth herein. 

15 All these methods, however, employ only image (i.e., spatial) information 

for analysis. A whole new dimension of analysis may be added using spectral 
information which reflects the interaction between light and matter. The 
combination of both spatial and spectral information will largely contribute to 
cancer detection and classification. 

20 There is thus a widely recognized need for, and it would be highly 

advantageous to have, spectral bio-imaging methods and spectral morphometric 
methods for cells classification devoid of the above described limitations, 
especially the subjectivity of pathologists in neoplasm diagnosis, which provide 
advanced and quantitative, semi or fully automatic, means for cancer 

25 classification. In addition there a widely recognized need for, and it would be 
highly advantageous to have, spectral bio-imaging method which accounts for 
day-to-day variation associated with most of the presently employed cell staining 
protocols. 

30 SUMMARY OF THE INVENTION 

According to the present invention there are provided spectral bio-imaging 
methods which can be used for automatic and/or semiautomatic spectrally 
resolved morphometric classification (e.g., grading) of cells (e.g., neoplasm). 

The methods can also be used for classification of cells into grades, 
35 developmental stages, and to qualify and quantify metabolic processes within 
cells. The method can further be used to develop new and more fine tuned 
indexes for neoplasm and embryonic cells classification. 
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According to further features in preferred embodiments of the invention 
described below, there is provided a method of spectral-morphometric analysis of 
biological samples, the biological samples including substantially constant 
components and suspected variable components, the method comprising the steps 

5 of (a) using a spectral data collection device for collecting spectral data of picture 
elements of the biological samples; (b) defining a spectral vector associated with 
picture elements representing a constant component of at least one of the 
biological samples; (c) using the spectral vector for defining a correcting function 
being selected such that when operated on spectral vectors associated with picture 

10 elements representing other constant components, spectral vectors of the other 
constant components are modified to substantially resemble the spectral vector; 
(d) operating the correcting function on spectral vectors associated with at least 
the variable components for obtaining corrected spectral vectors thereof; and (e) 
classifying the corrected spectral vectors into classification groups. 

15 According to still further features in the described preferred embodiments 

the method further comprising the step of (f) presenting pixels associated with 
each of the classification groups in a distinctive color. 

According to still further features in the described preferred embodiments 
the substantially constant components are red blood cells. 

20 According to still further features in the described preferred embodiments 

the red blood cells are added to the biological sample. 

According to still further features in the described preferred embodiments 
the red blood cells are inherent to the biological sample. 

According to still further features in the described preferred embodiments 

25 the suspected variable components are tumor cells, tumor tissues or parts thereof. 

According to still further features in the described preferred embodiments 
the tumor cells are hematopoietic tumor cells. 

According to still further features in the described preferred embodiments 
the suspected variable components are cells infected by a pathogen 

30 According to still further features in the described preferred embodiments 

the biological sample is a blood sample of a patient suspected to have or having a 
hematopoietic tumor. 

According to still further features in the described preferred embodiments 
the hematopoietic tumor is selected from the group consisting of leukemia and 

35 lymphoma. 

According to still further features in the described preferred embodiments 
the biological sample is of a patient suspected of having or having a disease 
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selected from the group consisting of ALL, CLL, IM, PCL 5 PLL and Sezary 
syndrome. 

According to still further features in the described preferred embodiments 
prior to collecting spectral data of picture elements of the biological samples, the 
5 biological sample is stained. 

According to still further features in the described preferred embodiments 
staining the biological sample is effected via a stain selected from the group 
consisting of an immunohistochemical stain, a histological stain, a DNA ploidy 
stain, a nucleic acid sequence specific probe and any combination thereof. 

10 According to still further features in the described preferred embodiments 

the histological stain is selected from the group consisting of Hematoxylin-Eosin 
stain, May Grunwald Giemsa stain, Romanowsky Giemsa, Masson's tri chrome 
and Papanicolaou stain. 

According to still further features in the described preferred embodiments 

15 collecting spectral data of picture elements of the biological samples is effected 
by (i) collecting incident light simultaneously from all pixels of the sample using 
collimating optics; (ii) passing the incident collimated light through an 
interferometer system having a number of elements, so that the light is first split 
into two coherent beams which travel in different directions inside the 

20 interferometer and then the two coherent beams recombine to interfere with each 
other to form an exiting light beam; (iii) passing the exiting light beam through a 
focusing optical system which focuses the exiting light beam on a detector having 
a two-dimensional array of detector elements, so that at each instant each of the 
detector elements is the image of one and always the same pixel of the sample for 

25 the entire duration of the measurement, so that the real image of the sample is 
stationary on the plane of the detector array and at any time during the 
measurement the image is still visible and recognizable, and so that each of the 
detector elements produces a signal which is a particular linear combination of 
light intensity emitted by the pixel at different wavelengths, wherein the linear 

30 combination is a function of the instantaneous optical path difference; (iv) 
scanning one or more of the elements of the interferometer system, so that the 
optical path difference between the two coherent beams generated by the 
interferometer system is scanned simultaneously for all the pixels of the sample; 
and (v) recording signals of each of the detector elements as function of time 

35 using a recording device to form a spectral cube of data. 

According to still further features in the described preferred embodiments 
collecting spectral data of picture elements of the biological samples is effected 
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by (i) illuminating the sample with broadband light through a step-scan 
interferometer and condenser; (ii) collecting and optically imaging transmitted or 
reflected light through the sample onto a two-dimensional array of detector 
elements (such as a CCD or focal plane array); (iii) recording a number of frames * 

5 from all the pixels of the sample in synchronization with each step-scanned 
position of the interferometer; (iv) mathematically processing each interferogram 
function so obtained for each pixel of the image to obtain a spectrum as function 
of wavelength for each of said pixels; and optionally, (v) performing spectral 
correction, classification or color display of the pixels based on their so obtained 

io and corrected spectral vectors, as described herein. 

According to still further features in the described preferred embodiments 
the spectral data collection device includes an element selected from the group 
consisting of a dispersion element, a filter and an interferometer. 

According to still further features in the described preferred embodiments 

15 classifying the corrected spectral vectors into classification groups is effected 
using a classification map algorithm which employs reference spectral vectors for 
associating picture elements into the classification groups. 

According to still further features in the described preferred embodiments 
the reference spectral vectors for classification are of a previously prepared 

20 reference library. 

According to still further features in the described preferred embodiments 
at least one of the reference spectral vectors for classification is of picture 
elements derived from a cell domain selected from the group consisting of 
nucleolus, inter-chromosomal region, cytoplasm, a first chromatin region of the 

25 nucleus, a second chromatin region of the nucleus and background. 

According to still further features in the described preferred embodiments 
the spectral vector is a normalized spectral vector. 

According to still further features in the described preferred embodiments 
classifying the corrected spectral vectors into classification groups is effected by 

30 spectral vector maxima classification. 

The present invention successfully addresses the shortcomings of the 
presently known configurations by providing a method for automatic or semi 
automatic and internally referenced method for classification and grading of 
neoplasm. Furthermore, the method of the present invention provides spectrally 

35 resolved morphometric classification images which may be used by pathologists 
for classification and grading of neoplasm, which images replace the prior art 
RGB images and lead to more objective interpretation of the results and 
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therefore, to a more accurate classification. This in turn may affect diagnosis, 
treatment and prognosis. 

BRIEF DESCRIPTION OF THE DRAWINGS 
5 The invention herein described, by way of example only, with reference to 

the accompanying drawings, wherein: 

FIG. 1 illustrates a conventional (prior art) slit-type imaging spectrometer. 
FIG. 2 is a block diagram illustrating the main components of an imaging 

spectrometer constructed in accordance with U.S. Pat. No. 5,539,517 (prior art). 
10 FIG. 3 illustrates a non-moving type interferometer, namely, a Sagnac 

interferometer, as used in an imaging spectrometer in accordance with U.S. Pat. 

No. 5,539,517 (prior art). 

FIG. 4 shows a definition of pseudo-RGB (Red, Green and Blue) colors 

for emphasizing chosen spectral ranges. The intensity for each of the RGB 
15 components is calculated by integrating the area under the spectrum of the pixel, 

after multiplying it by one of the three curves. 

FIG. 5 presents leukemia cells classified using the SPECTRACUBE™ 

system. The classification technique employed was based on pixel's spectrum 

classification according to the wavelength at which the spectrum is maximum. 
20 Classification colors are according to the definitions of Table 2 below. The black 

color stands for both background pixels, and pixels which remained unclassified 

because their spectrum was too different from any of the other classes. 

Peripheral blood samples were from normal healthy individuals (N) and from 

patients with typical acute lymphocytic leukemia (ALL), chronic lymphocytic 
25 leukemia (CLL), infectious mononucleosis (IM), plasma cell lymphoma (PCL), 

prolymphocyte leukemia (PLL) and Sezary syndrome (SEZARY), which were 

diagnosed according to established criteria. 

FIG. 6 presents variations among red blood cells (RBC's) spectra from 

various patients ALL212, CLL97, IM10, N7 } PCL28, PLL11, PLL24, 
30 SEZARY20 and SEZARY24, wherein the numbers indicate a specific patient of 

the specified disease. 

FIG. 7 presents cells derived from the various patients listed in Figure 6 

before (upper row) and after (lower row) modification using the correcting 

algorithm according to the present invention. 
35 FIGs. 8-14 show before and after correction results from various patients 

of the Normal, ALL, CLL, IM, PCL, PLL and SEZARY groups. Please note the 

identity of the RBC's after correction, among all measurements, and the similar 
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appearance of the cells after correction within each group and among the 
different groups. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

5 The present invention is of standardization of spectral measurements 

which can be used to allow automatic and/or semiautomatic spectrally resolved 
morphometric classification (e.g., grading) of cells (e.g., neoplasm, embryonic 
cells, etc.), despite the well known difficulties encountered in this field due to 
staining variability and/or instrumental drifts. Specifically, the present invention 

10 can be used to detect cellular spatial organization and to quantify cellular and 
tissue constituents and structures associated with tumorogenesis using light 
transmission microscopy combined with high spatial and spectral resolutions. 
This includes staining of cytological preparations or tissue sections with 
chromogenic dyes in the presence or absence of additional stained and/or tagged 

15 probes for the detection of protein and/or nucleic acid markers. The methods can 
also be used for classification of cells into developmental stages, and to qualify 
and quantify metabolic processes within cells. The method can further be used to 
develop new and more fine tuned indexes for neoplasm classification, bacterial 
infections, and other pathological states. 

20 

SPECTRAL IMAGING SYSTEMS 
For purposes of better understanding the present invention, as illustrated in 
Figures 4-14 of the drawings, reference is first made to the construction and 
operation of some spectral imaging systems (i.e., imaging spectrometers). 

25 A conventional (i.e., prior art) slit-type imaging spectrometer utilizing a 

two-dimensional array of detectors as illustrated in Figure 1. 

Thus, the prior art slit-type imaging spectrometer as illustrated in Figure 1 
comprises a collection optical system as indicated at 2, for collecting the incident 
light from a scene, schematically indicated at 4 and focusing the substantially 

30 parallel light of the scene 4 onto a first focal plane occupied by a slit 6 to define 
the field of view. The light exiting from slit 6 is collimated in a collimator lens 8 
and is passed through a spectral dispersion element 10 (e.g., a grating or a prism) 
to separate the various wavelengths. The output from spectral dispersion element 
10 is focused by a focusing lens 12 onto a two-dimensional detector array 14 in a 

35 second focal plane. The output of detector array 14 is fed to a signal processor 
16. 
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In the two-dimensional array of detectors 14 illustrated in the prior art 
imaging spectrometer of Figure 1, the movement of the system (e.g., a raster 
movement or line scanning indicated by arrow 13) effects the scanning along one 
dimension. The scanning along the second dimension is effected by the slit 6 

5 which is oriented perpendicularly to the direction of movement of the system. 
The slit 6 thus assures that each detector within the array 14 sees only the 
contribution of one pixel at a single wavelength at any time. This is necessary to 
separate the spectra of each pixel. 

As mentioned in the background section and hereinabove, the 

10 disadvantage of the prior art method illustrated in Figure 1 is that most of the 
pixels of one frame are not measured at any given time even though the optical 
system 2 actually collects light energy from all of them simultaneously. As a 
result, the required frame time is significantly increased, and/or the 
signal-to-noise ratio (sensitivity) is substantially decreased with respect to a 

1 5 system which does not have the need for such a slit. 

Figure 2 is a block diagram illustrating the main components of an 
improved prior art imaging spectrometer disclosed in U.S. Pat application No. 
08/392,019 to Cabib et aL, filed Feb. 21st, 1995, now U.S. Pat. No. 5,539,517, 
issued Jul. 23, 1996, which is incorporated by reference as if fully set forth 

20 herein. This imaging spectrometer is constructed highly suitable to implement 
the methods of the present invention. 

Thus, the prior art imaging spectrometer of Figure 2 includes: a collection 
optical system, generally designated 20; a one-dimensional scanner, as indicated 
by block 22; an optical path difference (OPD) generator or interferometer, as 

25 indicated by block 24; a one-dimensional or two-dimensional detector array, as 
indicated by block 26; and a signal processor and display, as indicated by block 
28. 

A critical element in system 20 is the OPD generator or interferometer 24, 
which outputs modulated light corresponding to a predetermined set of linear 

30 combinations of the spectral intensity of the light emitted from each pixel of the 
scene to be analyzed. The output of the interferometer is focused onto the 
detector array 26. Thus, all the required optical phase differences are scanned 
simultaneously for all the pixels of the field of view, in order to obtain all the 
information required to reconstruct the spectrum of each pixel. The spectra of all 

35 the pixels in the scene are thus collected simultaneously with the imaging 
information, thereby permitting analysis of the image in a real-time manner. 
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The apparatus according to U.S. Pat. No. 5,539,517 may be practiced in a 
large variety of configurations. Specifically, the interferometer used may be 
combined with other mirrors as described in the relevant Figures of U.S. Pat. No. 
5,539,517. 

5 Thus, according to U.S. Pat. No. 5,539,517, few alternative types of 

interferometers may be employed. These include (i) a moving type 
interferometer in which the OPD is varied to modulate the light, namely, a 
Fabry-Perot interferometer with scanned thickness; (ii) a Michelson type 
interferometer which includes a beamsplitter receiving the beam from an optical 

io collection system and a scanner, and splitting the beam into two paths; (iii) a 
Sagnac interferometer optionally combined with other optical means in which 
interferometer the OPD varies with the angle of incidence of the incoming 
radiation, and (iv) a four-mirror plus beamsplitter interferometer as further 
described and exemplified in the cited U.S. Pat. application. 

15 Figure 3 illustrates an imaging spectrometer constructed in accordance 

with U.S. Pat. No. 5,539,517 utilizing an interferometer in which the OPD varies 
with the angle of incidence of the incoming radiation. A beam entering the 
interferometer at a small angle to the optical axis undergoes an OPD which varies 
linearly with this angle. 

20 In the interferometer of Figure 3, all the radiation from source 30 in all the 

pixels, after being collimated by an optical collection system 31, is scanned by a 
mechanical scanner 32. The light is then passed through a beamsplitter 33 to a 
first reflector 34 and then to a second reflector 35, which reflects the light back 
through the beamsplitter 33 and then through a focusing lens 36 to an array of 

25 detectors 37 (e.g., a CCD). This beam interferes with the beam which is reflected 
by 33, then by second reflector 35, and finally by first reflector 34. 

An imaging spectrometer in accordance with the invention disclosed in 
U.S. Pat. No. 5,539,517 was developed by Applied Spectral Imaging (ASI) Ltd., 
Industrial Park, Migdal Haemek, Israel and is referred hereinbelow as 

30 SPECTRACUBE™. The SPECTRACUBE™ system optically connected to a 
variety of optical devices was used to implement the methods of the present 
invention. The SPECTRACUBE™ system has the following characteristics, 
listed hereinbelow in Table 1: 
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TABLE 1: 

Parameter Performance 

5 Spatial resolution: 30/M fxm (M=effective microscope or fore 

optics magnification) 
Field of View: 8/M millimeter 

Sensitivity: 20 milliLux (for 100 msec integration time, 

increases for longer integration times linearly 
10 with Vt) 

Spectral range: 400- 1 000 nm 

Spectral resolution: 4 nm at 400 nm (16 nm at 800 nm) 

Acquisition time: 5-50 sec, typical 15-25 sec 

FFT processing time: 20- 1 80 sec, typical 60 sec 

15 

The SPECTRACUBE™ system easily attaches to any microscope or 
macro lens with, for example, C-mount or F-mount connectors, and can stand in 
any orientation during the measurement. The system may as well be connected to 
other magnification means and to various types of endoscopes and cameras. 

20 Therefore, spectral images of cells and tissues in various magnification and 
lighting strategies may be obtained. 

The SPECTRACUBE™ system has numerous utilities. For examples of 
the use of the SpectaCube™ system for various biological applications, the reader 
is referred to U.S. Pat application No. 08/571,047, and to E. Schroeck et al 

25 (1996) Multicolor spectral karyotyping of human chromosomes. Science, 273, 
494-497; Garini et al (1996) Spectral Karyotyping, Bioimaging 4, 65-72; 
Malik et al (1996) Fourier transform multipixel spectroscopy and spectral 
imaging of protoporphyrin in single melanoma cells, Photochemistry and 
photobiology 63, 608-614; Malik et al. (1996) Fourier transform multipixel 

30 spectroscopy for quantitative cytology, Journal of Microscopy 182, 133-140; 
Garini et al (1996) Spectral Bio-Imaging, Fluorescence imaging spectroscopy 
and microscopy, chapter 4, ed. X.F. Wang and B. Herman, Chemical Analysis 
Series, Vol. 137, John Wiley and Sons; Soenksen et al (1996) Use of novel 
spectral bio-imaging system as an imaging oximeter in intact rat brain, SPIE 

35 Proceedings 2679; Liyanage et al. (1996) Multicolor spectral karyotyping of 
mouse chromosomes, Nature Genetics 14, 312-315; all are incorporated by 
reference as if fully set forth herein. 
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The prior art SPECTRACUBE™ system is used herein to acquire spectral 
data of every pixel of cancer cells. However, any spectral imager, i.e., an 
instrument that measures and stores in memory for later retrieval and analysis the 
spectrum of light emitted by every point of an object which is placed in its field 
of view, including filter (e.g., acousto-optic tunable filters (AOTF) or liquid- 
crystal tunable filter (LCTF)) and dispersive element (e.g., grating or prism) and 
spectral imagers based on interferometers built in a different configuration than 
SPECTRACUBE, can be used to acquire the required spectral data. Therefore, it 
is intended not to limit the scope of the present invention for use of any specific 
type of spectral imager. 

DISPLAY AND ANALYSIS OF SPECTRAL IMAGES 
a. General 

As mentioned above, a spectral image is a three dimensional array of data, 
I(x,y,A), that combines spectral information with spatial organization of the 
image. As such, a spectral image is a set of data called a spectral cube, due to its 
dimensionality, which enables the extraction of features and the evaluation of 
quantities that are difficult, and in some cases even impossible, to obtain 
otherwise. Since both spectroscopy and digital image analysis are well known 
fields that are covered by an enormous amount of literature [see, for example, 
Jain (1989) Fundamentals of Digital Image Processing, Prentice-Hall 
International], the following discussion will focus primarily on the benefit of 
combining spectroscopic and imaging information in a single data set, i.e., a 
spectral cube. 

One possible type of analysis of a spectral cube is to use spectral and 
spatial data separately, i.e., to apply spectral algorithms to the spectral data and 
two-dimensional image processing algorithms to the spatial data. 

As an example for a spectral algorithm consider an algorithm computing 
the similarity between a reference spectrum and the spectra of all pixels (i.e., 
similarity mapping) resulting in a gray (or other color) scale image (i.e., a 
similarity map) in which the intensity at each pixel is proportional to the degree 
of Similarity 1 . This gray scale image can then be further analyzed using image 
processing and computer vision techniques (e.g., image enhancement, pattern 
recognition, etc.) to extract the desired features and parameters. In other words, 
similarity mapping involves computing the integral of the absolute value of the 
difference between the spectrum of each pixel of the spectral image with respect 
to a reference spectrum (either previously memorized in a library, or belonging to 
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a pixel of the same or other spectral image), and displaying a gray level or 
pseudocolor (black and white or color) image, in which the bright pixels 
correspond to a small spectral difference, and dark pixels correspond to a large 
spectral difference, or vice versa. 
5 Similarly, classification mapping perform the same calculation as 

described for similarity mapping, yet takes several spectra as reference spectra, 
and paints each pixel of the displayed image with a different predetermined 
pseudocolor, according to its classification as being most similar to one of the 
several reference spectra. Both, similarity and classification mapping may 
10 employ any of the four following Equations (2-5). 

The reference spectrum can be one corresponding to a pixel in the same 
image, or from a library or from another image. 

There are many similarity map functions known in the literature, four are 
given hereinbelow: 

15 




20 

where Imax is the maximum intensity of the image, Gx, y is the brightness with 
which a pixel (of coordinates x and y) is displayed on the screen, hy(k) is its 
spectrum, <4/^» is the average of I^X) over the group of 3 x 3 neighboring 
pixels, S max is the peak intensity of I x /X) 9 T max is the peak intensity of <4//lJ>, R 
25 x is the reference spectrum with respect to which the similarity map is calculated, 
Rmax is the peak intensity of the reference spectrum Rx and n is the number of 
wavelengths of the measurement. 



WO 00/17808 



PCT/US99/20636 



20 

When similarity mapping is performed, it is clear that according to the 
above Equations 2-5, in all cases, the more a pixel spectrum is similar to the 
reference spectrum, the brighter it will be displayed on the screen. 

On the other hand, when classification is performed, a calculation using 
5 the spectrum of each of the pixels of the image, one at a time, and of each of the 
few reference spectra, one at a time, is performed (preferably after normalization 
of all spectra to a 0-100 % intensity range), and the analyzed pixel is given a 
preselected arbitrary color according to the reference spectra to which it is most 
similar using for example a minimal square error calculation, as well known in 
10 the art. 

It is also possible to apply spectral image algorithms based on non- 
separable operations; i.e., algorithms that include both local spectral information 
and spatial correlation between adjacent pixels (one of these algorithms is, as will 
be seen below, a principal component analysis). 

15 One of the basic needs that arise naturally when dealing with any three- 

dimensional (3D) data structure such as a spectral cube (i.e., I{xy,l)\ is 
visualizing that data structure in a meaningful way. Unlike other types of 3D data 
such as topographic data, D(x 9 y,z) 9 obtained for example by a confocal 
microscope, where each point represents, in general, the intensity at a different 

20 locations (x,y,z) in tree-dimensional space, a spectral image is a sequence of 
images representing the intensity of the same two-dimensional plane (i.e., the 
sample) at different wavelengths. For this reason, the two most intuitive ways to 
view a spectral cube of data is to either view the image plane (spatial data) or the 
intensity of one pixel or a set of pixels as function of wavelength in a three- 

25 dimensional mountain-valley display. In general, the image plane can be used for 
displaying either the intensity measured at any single wavelength or the gray 
scale image that results after applying a spectral analysis algorithm, over a 
desired spectral region, at every image pixel. The spectral axis can, in general, be 
used to present the resultant spectrum of some spatial operation performed in the 

30 vicinity of any desired pixel (e.g., averaging the spectrum). 

It is possible, for example, to display the spectral image as a gray scale 
image, similar to the image that might be obtained from a simple monochrome 
camera, or as a multicolor image utilizing one or several artificial colors to 
highlight and map important features. Since such a camera simply integrates the 

35 optical signal over the spectral range (e.g., 400 nm to 760 nm) of the CCD array, 
the 'equivalent' monochrome CCD camera image can be computed from the 3D 
spectral image data base by integrating along the spectral axis, as follows: 
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gray_scale(x,y)= ^w(l)-I(x,y,X)dX 

X2 

In Equation 5, w(X) is a general weighting response function that provides 
maximum flexibility in computing a variety of gray scale images, all based on the 
integration of an appropriately weighted spectral image over some spectral range. 
5 For example, by evaluating Equation 5 with three different weighting functions, 
{w r (A) t w g (A), w b (A)}, corresponding to the tristimulus response functions for red 
(R), green (G) and blue (B), respectively, it is possible to display a conventional 
RGB color image. It is also possible to display meaningful non-conventional 
(pseudo) color images. 

10 Figure 4 presents an example of the power of this simple algorithm. 

Consider choosing {>v r w b } to be Gaussian functions distributed "inside" a 
spectrum of interest, the resulting pseudo-color image that is displayed in this 
case emphasizes only data in the spectral regions corresponding to the weighting 
functions, enabling spectral differences in these three regions to be detected more 

15 clearly. 

b. Point operations 

Point operations are defined as those that are performed on single pixels, 

(i.e., do not involve more than one pixel at a time). For example, in a gray scale 

image, a point operation can be one that maps the intensity of each pixel 
20 (intensity function) into another intensity according to a predetermined 

transformation function. A particular case of this type of transformation is the 

multiplication of the intensity of each pixel by a constant. 

The concept of point operations can also be extended to spectral images: 

here each pixel has its own intensity function (spectrum), i.e., an n-dimensional 
25 vector F,(/L); /l€[/t„ A point operation applied to a spectral image can be 

defined as one that maps the spectrum of each pixel into a scalar (i.e., an intensity 

value) according to a transformation function: 

Building a gray scale image according to Equation 6 is an example of this 
30 type of point operation. In the more general case, a point operation maps the 
spectrum (vector) of each pixel into another vector according to a transformation 
function: 

VID = g( W)); N], Ae[A I9 U , where N< n. 
In this case a spectral image is transformed into another spectral image. 
35 One can now extend the definition of point operations to include 

operations between corresponding pixels of different spectral images. An 
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important example of this type of algorithm is optical density analysis. Optical 
density is employed to highlight and graphically represent regions of an object 
being studied spectroscopically with higher dynamic range than the transmission 
spectrum. The optical density is related to transmission by a logarithmic 
5 operation and is therefore always a positive function. The relation between the 
optical density and the measured spectra is given by Lambert Beer law: 

) 

where OD(A) is the optical density as a function of wavelength, I(X) is the 
measured spectrum, I 0 (A) is a measured reference spectrum, and x(X) is the 

10 spectral transmittance of the sample. The above Equation is calculated for every 
pixel for every wavelength where I 0 (A) is selected from (i) a pixel in the same 
spectral cube for which OD is calculated; (ii) a corresponding pixel in a second 
cube; and (iii) a spectrum from a library. 

Note that the optical density does not depend on either the spectral 

15 response of the measuring system or the non-uniformity of the CCD detector. 
This algorithm is useful to map the relative concentration, and in some cases the 
absolute concentration of absorbers in a sample, when their absorption 
coefficients and the sample thickness are known. 

Additional examples include various linear combination analyses, such as 

20 for example: (i) applying a given spectrum to the spectrum of each of the pixels 
in a spectral image by an arithmetical function such as addition, subtraction, 
multiplication division and combinations thereof to yield a new spectral cube, in 
which the resulting spectrum of each pixel is the sum, difference, product ratio or 
combination between each spectrum of the first cube and the selected spectrum; 

25 and (ii) applying a given scalar to the spectra of each of the pixels of the spectral 
image by an arithmetical function as described above. 

Such linear combinations may be used, for example, for background 
subtraction in which a spectrum of a pixel located in the background region is 
subtracted from the spectrum of each of the pixels; and for a calibration 

30 procedure in which a spectrum measured prior to sample analysis is used to 
divide the spectrum of each of the pixels in the spectral image. 

Another example includes a ratio image computation and display as a gray 
level image. This algorithm computes the ratio between the intensities at two 
different wavelengths for every pixel of the spectral image and paints each of the 

35 pixels in a lighter or darker artificial color accordingly. For example, it paints the 
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pixel bright for high ratio, and dark for low ratio (or the opposite), to display 
distributions of spectrally sensitive materials. 

c. Spatial-spectral combined operations 

In all of the spectral image analysis methods mentioned above, algorithms 

5 are applied to the spectral data. The importance of displaying the spectrally 
processed data as an image is mostly qualitative, providing the user with a useful 
image. It is also possible, however, depending on the application, to use the 
available imaging data in even more meaningful ways by applying algorithms that 
utilize the spatial-spectral correlation that is inherent in a spectral image. Spatial- 

10 spectral operations represent the most powerful types of spectral image analysis 
algorithms. As an example, consider the following situation: 

A sample contains k cell types stained with k different fluorophores (the 
term 'cell 1 here is used both for a biological cell, and also as ! a region in the field 
of view of the instrument'). Each fluorophore has a distinct fluorescence 

15 emission spectrum and binds to only one of the k cell types. It is important to 
find the average fluorescence intensity per cell for each one of the k cell types. 
To achieve this task the following procedure can be used: (i) classify each pixel 
in the image as belonging to one of £+1 classes {k cell types plus a background) 
according to its spectrum; (ii) segment the image into the various cell types and 

20 count the number of cells from each type; and (iii) sum the fluorescence energy 
contributed by each class, and divide it by the total number of cells from the 
corresponding class. 

This procedure makes use of both spectral and spatial data. The relevant 
spectral data takes the form of characteristic cell spectra (i.e., spectral 

25 "signatures"), while the spatial data consists of data about various types of cells 
(i.e., cell blobs) many of which appear similar to the eye. The ideal type of 
measurement for this type of situation is a spectral image. In the above situation, 
cells can be differentiated by their characteristic spectral signature. Hence, a 
suitable point operation will be performed to generate a synthetic image in which 

30 each pixel is assigned one of k+1 values. Assuming that the fluorescence 

emission spectra of the different cell types are known to be s t {A); i « 1, 2, , k, 

Xe[X v ;y, and the measured spectrum at each pixel (x, y) is s xy (X\ Ae[A } , AJ, 
then the following algorithm is a possible method of classification (step 1 above): 
Let e 1 i be the deviation of the measured spectrum from the known 

35 spectrum of the fluorophore attached to cell type /. Then, adopting a least- 
squares "distance" definition, one can write: 
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e}= Z(s(X)~ Si (X)) 2 

XeR X 

where R x is the spectral region of interest. Each point [pixel (x, y)] in the image 
can then be classified into one of the £+1 classes using the following criterion: 

5 point(x,y) e class k+1 ife^i > threshold for all i e [l,k] t 
whereas 

point (x t y) e class p ife^i < threshold, and p is such that min^iJ^ e^p 

Steps ii and iii above (image segmentation and calculation of average 
10 fluorescence intensity) are now straightforward using standard computer vision 
operations on the synthetic image created in accordance with the algorithm 
described in last two equations. 

Another approach is to express the measured spectrum s xy (X) at each pixel 

as a linear combination of the k known fluorescence spectra s t {A); i = 1, 2, , k. 

15 In this case one would find the coefficient vector C = [c u c 2 , , c k ] that solves: 

F=min E(s(X)~s(X)) 2 

XeR x 

k 

where s(X) - Jfc,- 

dF 

Solving for — =0;for i =7,2,...,&(i.e., find values of c% which minimize F) 

dc f 

yields the matrix Equation C = A~ l B, where A is a square matrix of dimension k 



20 with elements 



AeR x 



and B is a vector defined as 



, w,n=l,2,...,*. 

Arithmetic operations may similarly be applied to two or more spectral 
cubes and/or spectra of given pixels or from a library. For example consider 
applying an arithmetic operations between corresponding wavelengths of 
25 corresponding pairs of pixels belonging to a first spectral cube of data and a 
second spectral cube of data to obtain a resulting third spectral cube of data for 
the purpose of, for example, averaging two spectral cubes of data, time changes 
follow-up, spectral normalization, etc. 

In many cases, objects (e.g., cancer cells) present in a spectral image differ 
30 from one another in chemical constituents and/or structure to some degree. Using 
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a decorrelation statistical analysis such as principal component analysis by 
producing covariance or correlation matrices enhances these small differences. 

Decorrelation statistical analysis is directed at extracting decorrelated data 
out of a greater amount of data, and average over the correlated portions thereof. 

5 There are a number of related statistical decorrelation methods. Examples 
include but not limited to principal component analysis (PCA), canonical variable 
analysis and singular value decomposition, etc., of these methods PCA is perhaps 
the more common one, and is used according to the present invention for 
decorrelation of spectral data. However, considering the fact that all 

io decorrelation statistical methods including those listed above are related to one 
another, there is no intention to limit the scope of the invention to use of any 
specific decorrelation method. Specifically, there is no intention to limit the 
scope of the present invention to use of principal component analysis, as any 
other decorrelation statistical method may be alternatively employed. 

15 Information concerning the use and operation of the above listed decorrelation 
statistical methods is found in R. A. Johnson and D. W. Wichen, "Applied 
Multivariate Statistical Analysis, third edition, Prentice Hall (1992) and T. W. 
Anderson, An Introduction to Multivariance Statistical Analysis, second edition, 
Wiley and Sons (1984), both are incorporated by reference as if fully set forth 

20 herein. 

Furthermore, as will become apparent from the descriptions to follow, the 
implementation of a decorrelation statistical method may be done using various 
modifications. As the concept of the present invention is not dependent upon any 
specific modification, it is the intention that the scope of the present invention 

25 will not be limited to any specific modification as described below. 

Principal component analysis (PCA) is one of a number of powerful 
techniques used in multivariate statistical analysis. It is advantageous in cases 
where a large number of "results", which depend on a large number of possibly 
correlated variables forms the basic data set. Its strength lies in the fact that this 

30 data decomposition provides a transformation to decorrelated variables, while 
simultaneously averaging over correlated variables. 

In this paragraph the PCA technique as applied to multispectral images of 
the same object is delineated. The basic data set, i.e., the spectral cube, is 
composed of k spectral slices of the same object, where each spectral slice is 

35 obtained at a different spectral band. Thus, the data set is composed of the 
spectra of all the pixels of the object. One of the objectives of looking at such a 
data set can be the characterization of the pixels into groups of similar spectra. 
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Regard each spectral slice as a vector whose elements are the image pixels 
arranged into the column vector using a predetermined code. Call the spectral 
slices X m , so that the term x nm signifies the n-th pixel of the m-th spectral slice. 
In such way, the matrix x = {x nm } carries the full information, so that each 

5 column is a spectral slice. Define a matrix y derived from matrix x by subtracting 
from each column, the column average. The various columns of the y matrix 
may be correlated, so that, some of the information carried by the data is 
correlated. The PCA technique decorrelates the information and reduces it only 
to decorrelated variables, so that the amount of "real" data pixels is smaller and 

10 easier to handle. 

The correlations are obtained directly by computing the covariance matrix 
c defined by: 

c = y'y 

where y f is the transpose of y. The i,j term of c is the covariance of the i-th slice 
15 with the j-th slice, i.e. if they are decorrelated this term vanishes. The diagonal of 
c is composed of the variances of each spectral slice, which can be regarded as a 
scale for the amount of information in this particular slice. Alternatively, this 
variance (its square root) can be regarded as the average contrast of this particular 
slice. 

20 Linear algebra describes this situation as follows. The objects of interest 

(the pixels of the spectral slices, k of them) are points in a k dimensional space. 
The fact that the covariance matrix c shows correlations is represented by its 
having a rank smaller than k. This situation is called degeneracy and it means 
that the k (narrow band) spectral slices provide too much data relative to the 

25 information content. Reduction of the data is performed by finding the eigen 
system of the covariance matrix. Formally, this operation means that one has to 
find k vectors v ro called eigenvectors and k scalars X m called eigenvalues so 

that: 

c - v m=^m v ra for m = l,2,...,k 
30 In a case where the data is correlated, some of the eigenvalues vanish. 

The number of non-vanishing eigen-values defines the dimension of the 
information, which dimension is smaller than k. The corresponding eigen- 
vectors define a subspace in the original k space in which the full information 
content is represented. Furthermore, the information in each new dimension is 
35 completely decorrelated to the information in the other dimensions. Thus in the 
new space the full information content is represented in a decorrelated manner so 
that it can be easily used for classification purposes. For further details regarding 
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the principal component analysis, the reader is referred to Martens and Naes 
(1989) Multivariate Calibration, John Wiley & Sons, Great Britain; and to 
Esbensen et aL, Eds. (1994) Multi variance analysis - in practice; and, Computer- 
aided modeling as CAMO, and the Unscrambler's User's guide, Trondheim, 
5 Norway, both are incorporated by reference as if fully set forth herein. 

It should be noted that such an analysis can be performed on a whole 
spectral cube. Preferably, the analysis is performed only for selected pixels or 
mathematically manipulated (e.g., after background subtraction and averaging) 
selected pixels to improve the results and enable better classification later on. 
10 The preferred approach is described in more detail below, nevertheless, there is 
no intention to limit the scope of the present invention to the preferred approach 
employed, as different mathematical manipulations may be found useful for 
different data collection approaches (e.g., filter or dispersion element based 
spectral imagers). 

15 

TRANSMISSION MICROSCOPY 

Light microscopy is one of the most fundamental techniques for the 
visualization of cells and tissues in biology and pathology. Transmission 
microscopy suffers greatly from the inherently low contrast of cell organelles 

20 and structural details. Many methods have been developed to improve this 
contrast, among them staining, spatial filtering and others. The use of the 
spectral bio-imaging methods of the present invention with stained cells and 
tissues is one of the most straightforward methods to increase even further their 
apparent contrast, when examined under a transmission microscope, thereby 

25 improving dramatically the identification and discrimination capabilities of this 
popular microscopic method. The basic approach proposed herein is to measure 
a spectral image, and to then use this large amount of information in conjunction 
with spectral and morphological analysis methods and algorithms in order to 
identify and map cellular and subcellular details. 

30 In order to facilitate the histological examination of biological specimens, 

a variety of staining techniques were developed during the last century using 
organic stains which specifically bind to different macromolecules in the cells, 
though the molecular basis of the staining techniques has been and still is 
empirical. Other image contrast enhancement methods include the use of spatial 

35 filtering techniques such as dark field and polarization methods [see, Kam (1987) 
Quarterly Reviews of Biophysics, 20, pp. 201-259]. The most common staining 
techniques are the May Grunwald Giemsa, Romanowsky-Giemsa, Hematoxylin- 



WO 00/17808 



PCT/US99/20636 



28 

Eosin, Masson's trichrome and Papanicolaou staining. The Romanowsky- 
Giemsa staining procedure, for example, uses a combination of two dyes, one of 
which is Azure-B (trimethyl methionine), a thiazin dye, and the second being 
Eosin Y (hydroxyxanthene bromide). The thiazines are cationic dyes and 

5 therefore bind to acidic cellular constituents, whereas Eosin is an anionic dye and 
tends to bind to basic cellular constituents. It is widely accepted that the use of 
these two components creates the so-called Romanowsky-Giemsa effect, which is 
expressed as the development of a specific purple color, a new dye complex, in 
some stained sites. The molecular basis of the azure-B-Eosin complex is obscure. 

io Some authors think that azure-B binds to anionic structures such as the phosphate 
groups of DNA, and that Eosin simultaneously binds both with an adjacent 
cationic site on the DNA and with the azure-B. In a more recently proposed 
model of the azure-B-Eosin complex, Friedrich and colleagues [Friedrich et al 
(1990) Histochemistry 93, pp. 247-256] have suggested that azure-B first binds to 

15 phosphodiester residues of the DNA molecule. The authors have hypothesized 
that the phenyl group of the Eosin molecule is the portion that binds to the azure- 
B molecule (which lies in a single plane). The color purple is a result of a red 
shift of the Eosin absorption peak, which in turn is caused by the dielectric 
polarization of bound Eosin. The very existence of such an azure-B-Eosin 

20 complex is still questioned by others [see, Friedrich et al (1990) Histochemistry 
93, pp. 247-256; Bottiroli et al (1994) Lasers in Surgery and Medicine; Profio 
(1984) IEEE Journal of Quantum Electronics QE-20 pp. 1502-1506; Herman 
(1989) Fluorescence Microscopy of Living Cells in Culture, part B, Chapter 8, 
pp. 219-243, edited by Taylor and Wang, Academic Press Inc.; and, Jovin and 

25 Arndt- Jovin (1989) Cell structure and function by microspectrofluorometry, 
Chapter 5, Academic Press Inc.]. 

Whatever the technique, with staining and/or chromogenic dying of cells 
and tissue sections it is possible to distinguish between subcellular compartments 
of the cell, and especially to distinguish the chromatin organization in the 

30 nucleus, proteins by means of tagged antibodies and genetic markers by means of 
labeled and hybridized probes. It is well established that the ratio between 
heterochromatin, stained dark blue, and euchromatin, stained pink, is one of the 
major determinants in the evaluation of cells in tissue sections. Also, it is well 
established that the simultaneous presence of certain combinations of proteins 

35 and genetic markers, and combinations of particular quantities, distributions and 
locations of same, are indicative of cancer type, grade, progression, and are used 
for diagnosis and prognosis. Similar applications of such technique are found in 
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the detection, classification and diagnosis of infective diseases, due to bacteria, 
viruses of different types, and other pathogens. Nevertheless, the results obtained 
from stained specimens remain, to some degree, a matter of experience, art, and 
subjective interpretation. In order to diminish the effect of the scientist's 
5 experience, there have been attempts to study the spectroscopic characteristics of 
the interaction between organic stains and macromolecules, and thus to evaluate 
the so-called Romanowsky-Giemsa Effect of DNA staining. Spectral imaging 
applied to transmission light microscopy can greatly improve the quantitative 
measurement of size, shape and textural features of cell organs, cells and tissues. 

io This technique is known as morphometry, which is a rapidly growing field in 
biology and pathology [Erler et ai (1993) Modern Pathology, 6, pp. 612-618]. 
As shown herein, morphometric spectral image (as opposed to simple 
morphometric image) analysis enables the evaluation of subtle cytological and 
histological features to yield useful ultrastructural and medical information for 

1 5 diagnostic and prognostic evaluation. 

In some cases, spectral images acquired using transmission methods and 
unstained tissue may provide useful information, similar to that found in 
fluorescence microscopy techniques. One of the advantages of combining 
spectral bio-imaging and transmission microscopy without staining is the ability 

20 to use a "clean" measurement technique, i.e., no need for working with 
potentially toxic dyes or fixation agents. 

Thus, according to the present invention there is provided a method of 
spectral-morphometric analysis of biological samples which include substantially 
constant components and suspected variable components. The method is effected 

25 by executing the following method steps, in which, in a first step a spectral data 
collection device is employed for collecting spectral data of picture elements of 
the biological samples. In a second step of the method, a spectral vector 
associated with picture elements representing a constant component of at least 
one of the biological samples is defined. In a third step of the method, that 

30 spectral vector is used for defining a correcting function which is selected such 
that when operated on spectral vectors associated with picture elements 
representing other constant components, the spectral vectors of the other constant 
components are modified to substantially resemble the above spectral vector. In a 
fourth step of the method the correcting function is operated on spectral vectors 

35 associated with at least the variable components for obtaining corrected spectral 
vectors thereof. Finally, the corrected spectral vectors are classified into 
classification groups. 
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The method according to the present invention preferably further includes 
a step in which pixels associated with each of the classification groups are 
presented in a distinctive color, e.g., on a display (monitor, computer screen, 
print, etc.). 

The method according to the present invention is thus designed to provide 
modified spectral vectors of pixels associated with suspected variable 
components, which modified spectral vectors provide a better basis for 
classification by neutralizing variability of staining and/or instrumentation 
instability. Thus, the spectral vectors of the variable components are rendered 
independent of the measurement itself, and therefore allow for the building of 
spectral vector libraries and aid in the automatization of the analysis of the 
samples. 

As used herein in the specification and in the claims section below, the 
term "spectral vector" refers to any type of spectral data, including, but not 
limited to, a spectrum. Also spectral data collected using, for example, a plurality 
(two or more) of specific band filters, e.g., narrow band filters, falls under this 
term. 

As used herein in the specification and in the claims section below, the 
term "biological sample" refers to a sample retrieved from an animal, mammals 
and human beings in particular. The sample may be of a healthy tissue, disease 
tissue or tissue suspected of being disease tissue. The sample may be a biopsy 
taken, for example, during a surgical procedure. The sample may be collected via 
means of fine needle aspiration, scraping or washing a cavity to collects cells or 
tissue therefrom. The sample may be of a tumor both solid and hematopoietic 
tumors, as well as of neighboring healthy tissue. The sample may be a smear of 
individual cells or a tissue section. 

As used herein in the specification and in the claims section below, the 
phrase "substantially constant components" refers to objects which should have 
the same spectrum when measured at different times under the same conditions, 
irrespective of the type of sample in which they are present. For example, red 
blood cells (RBC's) should have the same spectrum whether they are in a sample 
derived from a healthy person or from a leukemia patient, because it is assumed 
that their chemical composition does not change with the disease. Therefore, red 
blood cells are presently the preferred substantially constant components. In 
cases in which, for a reason or another, this assumption is not valid, inherently or 
substantially constant red blood cells derived from healthy blood or other 
constant biological material can be added to the sample to serve as the reference 
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according to the present invention. In hematopoietic tumors red blood cells are 
inherently present in the examined samples. In solid tumors they are preferably 
added to at least a portion of the sample and otherwise they are used invariably as 
the reference material as described herein. 

5 As used herein in the specification and in the claims section below, the 

phrase "suspected variable components" refers to objects which may have 
different characterizing spectra in patients of different diseases, as opposed to 
healthy individuals. According to an embodiment of the present invention, the 
suspected variable components are tumor cells, being analyzed for classification 

l o into tumor type and grade. 

Thus, the method provided herein is basically a "calibration" or spectral 
"standardization" method, which allows a more meaningful comparison between 
different measurements by correcting out spectral shifts or distortions due to stain 
variability and/or instrumental instabilities. 

15 Hematopoietic tumors according to the present invention include 

leukemias, lymphomas and other blood diseases, including, but not limited to, 
ALL, CLL, IM, PCL, PLL and Sezary syndrome. 

Different stains bind different cellular constituents in different affinities, 
yet due to the presence of stain, a spectrum which is unique to each stained 

20 constituent is obtained. Suitable stains include but are not limited to 
Hematoxylin-Eosin staining and Giemsa staining or for some applications 
immunostaining [see, for example, Goto M, Nagatomo Y, Hasui K, Yamanaka H 
Murashima S and Sato E (1992) Chromaticity analysis of immunostained tumor 
specimens. Pathol. Res. Pract. 188:433]. However, it will be appreciated that for 

25 some applications cells which have not been stained are also suitable or preferred. 
This depends in part on lighting strategy and type of microscope employed, all as 
well known in the art. 

Thus, according to a preferred embodiment of the present invention, prior 
to collecting spectral data of picture elements of the biological samples, the 

30 biological samples are stained, e.g., via immunohistochemical stain, a histological 
stain, a DNA ploidy stain, nucleic acid (DNA or RNA) sequence specific probes 
(from single locus, gene or EST sequence to whole chromosome or chromosomes 
paints) or any combination thereof. The histological stain can be, for example, 
Hematoxylin-Eosin stain, Giemsa stains of different types, Masson's trichrome or 

35 Papanicolaou stain. 

These stains are presently widely used in tumor classification and grading 
as they differentially stain different classes and grades. Such stains can enhance 
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the unique features of the tumor cells according to the present invention by 
attributing distinctive spectral signatures in a spatial dependent manner, resulting 
in improved spectral morphometry. 

As used herein in the specification and in the claims section below, the 
5 term "stained" or "staining" refers to a process in which coloration is produced by 
foreign matter having penetrated into and/or interacted with the biological 
sample. 

As used herein in the specification and in the claims section below, the 
term "stain" or "stains" refers to colorants, either fluorescent, luminescent and/or 

10 non-fluorescent (chromogenes) and further to reagents or matter used for 
effecting coloration. 

As used herein in the specification and in the claims section below, the 
term "immunohistochemical stain" refers to colorants, reactions and associated 
reagents in which a primary antibody which binds a cytological marker is used to 

15 directly or indirectly (via "sandwich" reagents and/or an enzymatic reaction) stain 
the biological sample examined. Immunohistochemical stains are in many cases 
referred to in the scientific literature as immunostains, immunocytostains, 
immunohistopathological stains, etc. 

As used herein in the specification and in the claims section below, the 

20 term "histological stain" refers to any colorant, reaction and/or associated 
reagents used to stain cells and tissues in association with cell components such 
as types of proteins (acidic, basic), DNA, RNA, lipids, cytoplasm components, 
nuclear components, membrane components, etc. Histological stains are in many 
cases referred to as counterstains, cytological stains, histopathological stains, etc. 

25 As used herein in the specification and in the claims section below, the 

term "DNA ploidy stain" refers to stains which stoichiometrically bind to 
chromosome components, such as, but not limited to, DNA or histones. When an 
antibody is involved, such as anti-histone antibody, such stains are also known as 
DNA immunoploidy stains. 

30 Lists of known stains are provided in U.S. Pat. application No. 

09/122,704, filed July 27, 1998, which is incorporated by reference as if fully set 
forth herein. 

As used herein in the specification and in the claims section below, the 
phrase "nucleic acid sequence specific probe" refers to polynucleotides labeled 
35 with a label moiety which is either directly or indirectly detectable, which 
polynucleotides being capable of base-pairing with matching nucleic acid 
sequences present in the biological sample. 
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As used herein in the specification and in the claims section below, the 
term "spectral data collection device 1 ' refers to any device capable of detecting 
light intensity associated with a plurality, typically four or more, of distinct 
spectral bands in each spatial element (pixel) of the examined sample. For 

5 example, the SPECTRACUBE™ system optically connected to a microscope 
preferably serves as the spectral data collection device according to the present 
invention. However, any spectral imager, i.e., an instrument that measures and 
stores in memory for later retrieval and analysis the spectrum of light emitted by 
every point of an object which is placed in its field of view, including filters (e.g., 

io conventional, acousto-optic tunable filter (AOTF) or liquid-crystal tunable filter 
(LCTF)) and dispersive element (e.g., grating or prism) based spectral imagers, or 
other spectral data or multi-band light collection devices (e.g., a device in 
accordance with the disclosure in Speicher R. M, Ballard S. G. and Ward C. D. 
(1996) Karyotyping human chromosomes by combinatorial multi-fluor FISH. 

15 Nature Genetics, 12:368-375) can be used to acquire the required spectral data. 
Also a device which includes a plurality of wide band filters, fixed, tunable, or 
built according to any mathematical definition, either based on decorrelation 
methods according to the procedures explained above and, for example, in U.S. 
Pat. No. 5,719,024, or others, or as described in U.S. Pat. application No. 

20 08/917,213, filed August 25, 1997, which is incorporated by reference as if fully 
set forth herein, can be used as the spectral data collection device according to the 
present invention. An additional possible type of spectral data collection device 
that can be used according to the present invention is one that is known in the 
literature as a "Step-scan infrared imaging system" sold by BioRad Laboratories 

25 Inc. of Cambridge MA, USA, arid described in: Fourier Transform Spectroscopic 
Imaging Using an Infrared Focal-Plane Array Detector, by E. Neil Lewis et al., 
Analytical Chemistry, Vol. 67, No. 19, October 1, 1995, pp. 3377-3381, and 
histopathological applications of it are described in: Infrared Spectroscopic 
Imaging as a Tool for Pathology, by Linda H. Kidder et al., SPIE Proceedings 

30 Vol. No. 3257, Conference held in S. Jose Cal., USA, Jan. 24 to 30, 1998, and 
sold by BioRad Laboratories under the commercial name of Stingray 6000. It 
operates on unstained samples using IR light transmission, and it could be used 
with stained samples, if its optics were adapted for visible light. In such a system 
a commercial FT-IR step-scan interferometer is coupled to an IR microscope; 

35 samples mounted on quartz microscope slides are analyzed in transmission mode. 
The IR image is collected with a Cassegrain (reflective) objective. The image is 
projected to a liquid nitrogen-cooled InSb FPA (Focal Plane Array) detector (128 
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array should be replaced by a CCD or similar detector sensitive to visible light, 
the imaging lenses and other optics should be adapted to transmit and/or reflect 
visible light, and other system modifications should be introduced to make sure 

5 that the field, of view, spectral resolution, spatial resolution, measurement time, 
etc. are all reasonable and within feasible ranges. The interferometer timing and 
image acquisition are controlled externally via a computer. Therefore, it is 
intended not to limit the scope of the present invention for use of any specific 
type of spectral data collection device, nor to any specific type of spectral imager. 

10 Thus, the spectral data collection device can be an interferometer-based 

spectral data collection device of any kind, filter(s)-based spectral data collection 
device and a dispersion element-based spectral data collection device. 

According to a preferred embodiment of the present invention, collecting 
spectral data of picture elements of the biological samples is effected by (i) 

15 collecting incident light simultaneously from all pixels of the sample using 
collimating optics; (ii) passing the incident collimated light through an 
interferometer system having a number of elements, so that the light is first split 
into two coherent beams which travel in different directions inside the 
interferometer and then the two coherent beams recombine to interfere with each 

20 other to form an exiting light beam; (iii) passing the exiting light beam through a 
focusing optical system which focuses the exiting light beam on a detector having 
a two-dimensional array of detector elements, so that at each instant each of the 
detector elements is the image of one and always the same pixel of the sample for 
the entire duration of the measurement, so that the real image of the sample is 

25 stationary on the plane of the detector array and at any time during the 
measurement the image is still visible and recognizable, and so that each of the 
detector elements produces a signal which is a particular linear combination of 
light intensity emitted by the pixel at different wavelengths, wherein the linear 
combination is a function of the instantaneous optical path difference; (iv) 

30 scanning one or more of the elements of the interferometer system, so that the 
optical path difference between the two coherent beams generated by the 
interferometer system is scanned simultaneously for all the pixels of the sample; 
and (v) recording signals of each of the detector elements as function of time 
using a recording device to form a spectral cube of data. 

35 According to a preferred embodiment of the present invention classifying 

the corrected spectral vectors into classification groups is effected using a 
classification map algorithm which employs reference spectral vectors for 



WO 00/17808 



PCT/US99/20636 



35 

associating picture elements into the classification groups. The reference spectral 
vectors used for classification can be derived from a previously prepared 
reference spectral vectors library. According to a preferred embodiment of the 
present invention at least one of the reference spectral vectors for classification is 
5 of picture element(s) derived from a cell domain selected from the group 
consisting of nucleolus, inter-chromosomal region, cytoplasm, a first chromatin 
region of the nucleus, a second chromatin region of the nucleus and background. 
Classification can alternatively be effected by spectral maxima classification, as 
further exemplified in the Examples section below. 

10 

Each of the various embodiments and aspects of the present invention as 
delineated hereinabove and as claimed in the claims section below finds 
experimental support in the Examples section that follows. 

15 EXAMPLES 

Reference in now made to the following examples, which together with 
the above descriptions, illustrate the invention. 

Materials and methods 

20 May Grunwald Giemsa (MGG) staining of peripheral blood specimens: 

Peripheral blood was obtained from normal healthy individuals and from 
patients with typical acute lymphocytic leukemia (ALL), chronic lymphocytic 
leukemia (CLL), infectious mononucleosis (IM), plasma cell lymphoma (PCL), 
prolymphocyte leukemia (PLL) and Sezary syndrome (SEZARY), which were 

25 diagnosed according to established criteria. The patients did not receive 
chemotherapy for at least 3 months before obtaining the samples. 

Fourier-Transform Multipixel Spectrometry System for Microscopy: 
The SPECTRACUBE™ system (Applied Spectral Imaging (ASI) Ltd., Industrial 
Park, Migdal Haemek, Israel) was used for spectral imaging of the samples. The 

30 SPECTRACUBE™ system employed includes a Sagnac interferometer which is a 
particular type of triangular interferometer (see Figure 3 above) and has high 
mechanical and thermal stability. The light beam passing through the specimen 
is split in the interferometer in different directions, and is united again at the exit 
with an optical path difference (OPD) which is a function of the angle (9) 

35 between the incoming beam and the optical axis of the interferometer itself. The 
OPD arises because for non-zero angles the two beams undergo different optical 
paths in the beamsplitter. The inherent mechanical stability of this interferometer 
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allows the Fourier technique to be successfully applied to the visible spectral 
region. Wavelength calibration is performed by measuring a series of known 
monochromatic sources and then building a quadratic best-fit table of the 
wavelength versus "channel" parameter, the independent variable proportional to 

5 l/5i (resulting from the fast Fourier transform, FFT). The interferometer forms 
interference fringes at infinity, so that they show up on the CCD focal plane as 
lines of intensity modulation superimposed on the image of the sample. The 
actual measurement is done by recording successive CCD frames in 
synchronization with the steps of the motor used to rotate the collimated beam, so 

10 that the instantaneous OPD is known for every pixel in every recorded frame and 
can be used in the FFT calculation. During a measurement, each detector 
element of the CCD (512 x 512, in this case) is collecting an interferogram, 
which is then Fourier transformed to give the spectrum of the corresponding 
pixel. The spectral and spatial resolutions, spectral range and other 

15 characteristics of the system employed are summarized in Table 1, above. 

Spectral classification analysis: Spectral correction or standardization, 
using the spectrum of pixels associated with red blood cells, as further detailed 
hereinbelow was used prior to classification to enhance thereafter spectral 
features and to correct for spectral differences associated with e.g., sample 

20 preparation, source, etc. This latter procedure, in effect, is the gist of the present 
invention. 

Modeling and description of the method 
To model and describe the method of the present invention, consider the 
25 following definitions and procedures. 

Define the spectrum of the substantially constant component (red blood 
cells averaged, for example, over 5 pixels in the examples used in this 
specifications) taken from one of the spectral image measurements, as SR(X) 9 
where A is the wavelength. Consider also the spectrum of the substantially 
30 constant component taken from another spectral image measurement, or a second 
measurement, for the purposes of this explanation, be it SRBC(A). 
Define for each of the above measurements respectively: 
IR(A) 9 l(X)\ spectral intensity functions of the illumination on the sample; 
CR, C: attenuation constants independent of wavelength and of pixel 
35 position, which may be due to dirt on the optics or any other cause; 
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KR(X), K(X): spectral response functions of the measurement system 
including the spectral transmission of the optics and the spectral response 
function of the detector array; 

SMR(X), SM(X)\ measured spectra of the same type of object M in the two 
5 different measurements (it could be cytoplasm, heterochromatin, euchromatin, an 
organelle, a stained protein by immunological labeling, a stained DNA section or 
gene, etc.) 

DR(X), D(X), DMR(X), DM(X): spectral transmission due to staining 
variability from measurement to measurement and from object to object, DR(X) 
10 and D(X) correspond to the RBC's of the reference and the second measurement 
respectively, DMR(X) and DM(X) correspond to the object, M, measured 
respectively in the reference and in the second measurement. 
One can then write: 

SR(X) = CR IR(X)DR(X)KR(X) i 
15 One can also write: 

SRBC(X) - C I(X)D(X)K(X) 
SMR(X) = CR IR(X)DMR(X)KR(X) and 
SM(X) = C I(X)DM (X)K(X). 



20 Define now the correction function for the second measurement, under the 

assumption that the illumination functions 1(X) and IR(A,), and the spectral 
response functions of the measurement system K(A,) and KR(A,) are not dependent 
on the pixel position within each measurement: 

wn, S *W _ C R I R {X)D R {X)K R {X) 
SmcW CI(X)D(X)K(X) 



The above assumption is needed because X(X), which is a function of I, 
IR, K and KR, is built from one region of the image, and used to correct spectra 
in another region of the image. 
30 The next step is to build a new spectral image by multiplying the 

correction function X(X) by the spectrum of each pixel of the second 
measurement. The resulting spectrum of an RBC cell will be: 

S RBC (X)^X(X)S RBC (X) = S R (X) 

35 

which is true by definition of X(X). 
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The resulting corrected spectrum of the object M will be: 



mV ' c/(A)Z)(A)/:(^) w z)(A) AA 

5 

Now assume thdXDR(X) t D(X), DMR(X), DM (A) are related by a distortion 
or variability function Y(X) as follows: 

D(X) = D R (X)Y(Z) 

io and 

D M {X) = D MR (X)Y(X) 

This assumption means that the spectral distortion due to variability of 
staining can be expressed by a function Y(X), which is specific of a spectral image 
15 measurement and is common to all the pixels of the measurement. Under this 
assumption we obtain, by eliminating Y(X) from the last two equations: 

D M WD«W = D {A) 
D(X) m 

20 and substituting this last relation into the expression for S M (X) we obtain: 



S M (X) = C R I R (X)D m (X)K R (X) = S m (X) 

This last relation means that the corrected spectrum of object M in the 
25 spectral image of the second measurement is equal to the spectrum of the same 
type of object as appearing in the spectral image of the reference measurement. 
The validity of the assumption of constancy of the function Y(X) over a spectral 
image can be checked in a practical measurement of controlled and known cells 
or tissue, by comparing similar types of cells from the same patient in different 
30 measurements, before and after the correction. 

Figure 11, for example, shows that this is a reasonable assumption: for 
example, all cells measured in IM10, IM11, PLL24, and SEZARY20 spectral 
images, while looking very different from the corresponding cells of the same 
disease of different patients before the correction, they show a very similar pixel 



WO 00/17808 



PCT/US99/20636 



39 

classification after the correction method explained above has been applied to 
them. 

Experimental Results 

5 Figure 5 presents leukemia cells classification using the SPECTRACUBE 

™ system, before any correction was applied. The classification technique 
employed was based on pixel's spectrum classification according to the spectral 
band in which the spectrum maximum occurs as follows. First, a spectral image 
(spectral cube) was measured. Second, the cube was normalized, i.e., stretched to 

10 a full dynamic range (0-1), by dividing it by a constant equal to the maximum 
signal present in the cube. Then, based on spectral maxima, each pixel was 
assigned a specific artificial color, according to the definition of Table 2 below. 
Table 2 below associates spectral bands of spectral maxima with classification 
colors. A total of nine classification groups were used: 8 for different cell 

15 features, and one, black, for all the pixels which are either background or are not 
classified in any of the other 8 groups. Similar results were obtained using a 
conventional classification approach as described hereinabove. 

TABLE 2 

20 

Spectral Maxima Range (nm) Artificial Color 



700.6-712.6 


Blue 


678.2 -689.2 


White 


657.3 -667.5 


Red 


637.9 -647.4 


Cyan 


619.8 -628.7 


Yellow 


602.9-611.2 


Black 


587.1-594.9 


Gray 


572.2-579.5 


Magenta 



Viewing the classification results shown in Figure 5, one observes that 
some differences between cells derived from the normal individual (N) and cells 
derived from each of the various patients (ALL, CLL, IM, PCL, PLL and 
35 SEZARY) are apparent. To a lesser extent, differences among cells within each 
group are observed as well. 



WO 00/17808 



PCT/US99/20636 



For each of the individuals studies, in addition to the nucleated cells, 
anucleated, red blood cell (RBC), which are not related to the disease are 
apparent. However, in some of the cases spectra associated with RBCs are 
variable. Compare, for example, the two left images of the IM group as 
5 compared to the other three images in the same group, or the fifth image in the 
PLL group as compared to the others. These variations raised the question 
whether the staining and measuring technique are stable enough and invariant to 
provide reproducible and indicative results. 

In order to overcome possible variations between different cubes a 
10 correction technique is needed. 

Such a technique, which is the gist of the present invention, is based on the 
stipulation that the properties of the red blood cell are inherently invariant, so that 
their spectrum should be invariant as well, and that a spectral change or shift due 
to differential staining affects the RBCs and the rest of the sample in a similar 
15 way. 

The variations among RBCs spectra from various patients were checked 
by constructing a mean spectrum (five pixel mean) of a red blood cell in each 
cube. These spectra are shown in Figure 6, for the following cubes, ALL212, 
CLL97, IM10, N7, PCL28, PLL11, PLL24, SEZARY20 and SEZARY24, 

20 wherein the numbers after the acronym of each type of disease indicate a specific 
patient affected by that specific disease. These cubes were chosen because each 
of them contains at least one well defined blood cell, which can be used to 
demonstrate the invention. 

One clearly observes that, indeed, there are spectral variations among 

25 cubes, wherein, in the example given, the RBCs of ALL212, PCL28 and PLL1 1 
have similar spectra, CLL97's is slightly different, SEZARY20 and SEZARY24's 
show a larger difference but are still very similar to each other, N7 and PLL24 do 
differ but are very close to each other and the green curve IM10 shows a vastly 
different spectrum. 

30 The spectral standardization procedure according to the present invention 

as described hereinabove was carried out for the nine cubes under discussion 
(ALL212, CLL97, IM10, N7, PCL28, PLL11, PLL24, SEZARY20 and 
SEZARY24). After the spectral correction was performed, the corrected cubes 
were classified, using the same procedure as described with respect to Figure 5. 

35 The classification results, before and after modification using the above 

standardization algorithm are shown in Figure 7, where the upper row shows the 
classification results before correction and the bottom row after correction. 
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One observes that, obviously, the ALL212 cube did not change at all since 
by definition, the correcting function for this cube is equal to 1 for all 
wavelengths, as easily seen from the equation defining the correcting function 
when substituting SR(X) for SRBC(X). The areas outside the nucleus, which 

5 should be invariant are indeed so. The most significant change occurred in the 
IM10 cube because the RBC spectrum in this cube is most different from the 
RBC spectrum of the ALL212 cube; now the corrected IM10 cube resembles 
much more the other IM cubes (see Figure 5), as expected. The two PLL and 
SEZARY cubes which vastly differ from one another prior to correction, are now 

l o similar to each other. 

These results indicate that this or a similar correction procedure may 
indeed aid to achieve a more meaningful comparison between different bright 
field measurements of stained cells or tissue sections, performed in different days 
and/or in different laboratories. Consequently, group identification should be 

1 5 performed using the corrected cubes and not the raw cubes. 

Figures 8-14 show results from various patients of the Normal, ALL, CLL, 
IM, PCL, PLL and SEZARY groups before and after correction. Please note the 
homogeneous appearance of the cells after correction in all groups and among 
groups. 

20 Thus, the following conclusions can be drawn from the above results. 

First, the variations inside groups are removed after normalization. Second, the 
spectral differences between most groups are very small. The spectra of the 
nucleus is vastly different than the red blood cells and the surrounding material. 

25 Although the invention has been described in conjunction with specific 

embodiments thereof, it is evident that many alternatives, modifications and 
variations will be apparent to those skilled in the art. Accordingly, it is intended 
to embrace all such alternatives, modifications and variations that fall within the 
spirit and broad scope of the appended claims. 
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WHAT IS CLAIMED IS: 

1. A method of spectral-morphometric analysis of biological samples, 
the biological samples including substantially constant components and suspected 
variable components, the method comprising the steps of: 

(a) using a spectral data collection device for collecting spectral data of 
picture elements of the biological samples; 

(b) defining a spectral vector associated with picture elements 
representing a constant component of at least one of the biological 
samples; 

(c) using said spectral vector for defining a correcting function being 
selected such that when operated on spectral vectors associated with 
picture elements representing other constant components, spectral 
vectors of said other constant components are modified to 
substantially resemble said spectral vector; 

(d) operating said correcting function on spectral vectors associated 
with at least said variable components for obtaining corrected 
spectral vectors thereof; and 

(e) classifying said corrected spectral vectors into classification groups. 

2. The method of claim 1, further comprising the step of: 

(f) presenting pixels associated with each of said classification groups 
in a distinctive color. 

3. The method of claim 1, wherein the substantially constant 
components are red blood cells. 

4. The method of claim 3, wherein said red blood cells are added to 
the biological sample. 

5. The method of claim 3, wherein said red blood cells are inherent to 
the biological sample. 

6. The method of claim 1, wherein said suspected variable 
components are.tumor cells, tumor tissues or parts thereof. 
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7. The method of claim 6, wherein said tumor cells are hematopoietic 
tumor cells. 

8. The method of claim 6, wherein the substantially constant 
components are red blood cells. 

9. The method of claim 1, wherein said biological sample is a blood 
sample of a patient suspected to have or having a hematopoietic tumor. 

10. The method of claim 9, wherein said hematopoietic tumor is 
selected from the group consisting of leukemia and lymphoma. 

11. The method of claim 1, wherein said biological sample is of a 
patient suspected of having or having a disease selected from the group 
consisting of ALL, CLL, IM, PCL, PLL and Sezary syndrome. 

12. The method of claim 1, wherein prior to collecting spectral data of 
picture elements of the biological samples, the biological sample is stained. 

13. The method of claim 12, wherein staining said biological sample is 
effected via a stain selected from the group consisting of an 
immunohistochemical stain, a histological stain, a DNA ploidy stain, a nucleic 
acid sequence specific probe and any combination thereof. 

14. The method of claim 13, wherein said histological stain is selected 
from the group consisting of Hematoxylin-Eosin stain, May Grunwald Giemsa 
stain, Romanowsky Giemsa stain, Masson's trichrome stain and Papanicolaou 
stain. 

15. The method of claim 1, wherein collecting spectral data of picture 
elements of the biological samples is effected by: 

(i) collecting incident light simultaneously from all pixels of said 
sample using collimating optics; 

(ii) passing said incident collimated light through an interferometer 
system having a number of elements, so that said light is first split 
into two coherent beams which travel in different directions inside 
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said interferometer and then said two coherent beams recombine to 
interfere with each other to form an exiting light beam; 

(iii) passing said exiting light beam through a focusing optical system 
which focuses said exiting light beam on a detector having a two- 
dimensional array of detector elements, so that at each instant each 
of said detector elements is the image of one and always the same 
pixel of said sample for the entire duration of the measurement, so 
that the real image of the sample is stationary on the plane of the 
detector array and at any time during the measurement the image is 
still visible and recognizable, and so that each of said detector 
elements produces a signal which is a particular linear combination 
of light intensity emitted by said pixel at different wavelengths, 
wherein said linear combination is a function of the instantaneous 
optical path difference; 

(iv) scanning one or more of said elements of said interferometer 
system, so that said optical path difference between said two 
coherent beams generated by said interferometer system is scanned 
simultaneously for all said pixels of said sample; and 

(v) recording signals of each of said detector elements as function of 
time using a recording device to form a spectral cube of data. 

16. The method of claim 1, wherein said spectral data collection device 
includes an element selected from the group consisting of a dispersion element, a 
filter and an interferometer. 

17. The method of claim 1, wherein classifying said corrected spectral 
vectors into classification groups is effected using a classification map algorithm 
which employs reference spectral vectors for associating picture elements into 
said classification groups. 

1 8. The method of claim 17, wherein said reference spectral vectors for 
classification are of a previously prepared reference library. 

19. The method of claim 17, wherein at least one of said reference 
spectral vectors for classification is of picture elements derived from a cell 
domain selected from the group consisting of nucleolus, inter-chromosomal 
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region, cytoplasm, a first chromatin region of the nucleus, a second chromatin 
region of the nucleus and background. 

20. The method of claim 1, wherein said spectral vector is a normalized 
spectral vector. 

21. The method of claim 1, wherein classifying said corrected spectral 
vectors into classification groups is effected by spectral vector maxima 
classification. 

22 . The method of claim 1 } wherein said suspected variable 
components are cells infected by a pathogen. 
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